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Abstract 

"d^" 

I A long-standing open question in information theory is to characterize the unicast capacity of 

, a wireless relay network. The difficulty arises due to the complex signal interactions induced in 

^ ■ the network, since the wireless channel inherently broadcasts the signals and there is interference 

' among transmissions. Recently, Avestimehr, Diggavi and Tse proposed a linear deterministic model 

in 

^ that takes into account the shared nature of wireless channels, focusing on the signal interactions 

rather than the background noise. They generalized the min-cut max-flow theorem for graphs to 
networks of deterministic channels and proved that the capacity can be achieved using information 



Q 

■ theoretical tools. They showed that the value of the minimum cut is in this case the minimum rank 

of all the adjacency matrices describing source-destination cuts. 

In this paper, we develop a polynomial time algorithm that discovers the relay encoding strategy 
to achieve the min-cut value in linear deterministic (wireless) networks, for the case of a unicast 
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■ connection. Our algorithm crucially uses a notion of linear independence between channels to 

■"sj" ' calculate the capacity in polynomial time. Moreover, we can achieve the capacity by using very 

d\ ' 
o . 

. strategies that achieve the unicast capacity of the linear deterministic (wireless) relay network. 



simple one-symbol processing at the intermediate nodes, thereby constructively yielding finite length 



^ ■ I. Introduction 



Let G = (K E) denote a directed graph with unit capacity edges. We can think of each edge 
of this graph as a channel orthogonal to all other channels, where each channel (edge) has a 
single input and a single output, and can be used to send a single symbol from the input to the 
output (unit capacity). We can then depict a node with multiple incoming and outgoing edges 
as having multiple inputs and multiple outputs, as determined by its adjacent edges, where 
inputs and outputs can be arbitrarily connected to each other within the node. For example. 
Fig. [Ha) depicts a node in a directed graph, and Fig. [TJb) the equivalent representation of 
this node. 



Wireless relay networks cannot be represented as graphs, due to the inherently shared nature 
of the wireless medium that causes complex signal interactions. In the wireless medium, 
transmissions are broadcasted, and may be received by multiple receivers at different signal 
strengths depending on path loss parameters. Moreover, there is interference between trans- 
missions, and the signal from different nodes in the network can be received at very different 
power at a given receiver (high dynamic range of received signals). The characterization 
of the unicast capacity of a wireless relay network has been an open problem for decades, 
mainly due to these complex signal interactions. 

Recently, Avestimehr, Diggavi and Tse BUl, ^ proposed a linear deterministic network 
model (we will call this ADT model) that takes into account the interactions between the 
signals in a wireless network, i.e., broadcasting and interference, and represents the noise 
by a deterministic threshold rather than a random variable. The symbols received below the 
noise threshold are discarded. The argument is that for high Signal-to-Noise-Ratio (SNR), 
it is the signal interactions that will dominate the performance, and thus the capacity of the 
deterministic could be very close to that of the noisy network. Thus networks of deterministic 
channels could be used as approximate models for wireless networks. 

The ADT model is based on the intuition of dividing the transmitted and received signals 
into symbols, where each symbol is transmitted at a different power level, and assuming 
that only symbols above a deterministic noise threshold will be successfully received. Deter- 
ministic networks can be over over an arbitrary field F^. In the following, when we do not 
explicitly specify the field, we will imply that the network operates over the binary field. 

As an example, consider a point-to-point AWGN channel: y = 2"^^x + z, and assume that 
input bits Xi,X2, ■■,Xn are transmitted from a node A, while a node B observes the signal y. 
The capacity is log(l -I- 2") ~ alog(2), assuming z is unit variance noise (a represents the 
channel gain in dB scale a riog(5A/^i?)l). The ADT model over F2 in this case is obtained 
by truncating the received signal and assuming that the a most significant bits (MSB) of 
X are always above the deterministic noise threshold and received successfully at node B. 
The parameter a captures the path loss and determines how many of the MSB bits of x are 
received at y. 

When broadcasting, each receiver node 5, will receive the m, MSB from the transmitted 
bits xi,X2,--,Xn, with < m, < n. For example, when in Fig. [2] node S transmits, node Ai 
receives both the transmitted bits, while node A2 receives only the MSB that was transmitted 
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with the higher power. The difference between the bit index at the transmitter and the bit 
index at the receiver represents path loss. 

Interference in the ADT model is modeled through bit-wise binary addition, unlike Gaus- 
sian networks, where interfering signals are added through regular addition. In Fig. |2] the bit 
y(, equals the binary addition (xor) of bits X3 and X4. Again, the signal from different nodes 
in the network can be received at different power at a given receiver. For example, node D 
observes at the xor of ^5 and xj, i.e., the MSB from node Bi and the 2'"' MSB from node 
B2. The generalization over an arbitrary field is straightforward, by substituting binary 
addition with addition over F^. 




Fig. 1. (a) A node in a directed graph, (b) equivalent representation through orthogonal channels, and (c) a 
node in a network of deterministic channels. 

In the ADT model, unlike graphs, channels are no longer orthogonal. Each input might 
be connected to multiple outputs belonging in different nodes, and the relationship between 
these inputs and outputs is determined by a set of linear equations. In Fig. |2l the channel 
between the nodes Ai, A2 and Bi, 82 can be described through the equations y^, = yj = X3+X4. 
A generic node of deterministic channel networks is depicted in Fig. [He). Loosely speaking, 
in deterministic networks, we can have Linear Dependence (LD) relationships between edges 
(we will make this precise in the following section), even though these edges might not be 
adjacent. For example, in Fig. |2l the edges (x3,y(,) and (jC4,j7) are linearly dependent. This 
makes challenging the task of calculating the min-cut value between a source-destination 
(S-D) pair and of identifying the node operations. 

Avestimehr, Diggavi and Tse generalized the min-cut max-flow theorem for graphs to 
networks of deterministic channels and proved that the capacity can be achieved using 
information theoretical tools. They showed that the value of the minimum cut is in this 
case the minimum rank of all the adjacency matrices describing source-destination cuts. For 
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Fig. 2. An example of a linear binary deterministic network. 



example, in Fig. [2] the minimum cut value equals 



rank 
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= 1. 



Note that there exists an exponential number of cuts, and thus identifying the capacity 
through exhaustive search becomes infeasible. In this paper, we develop a constructive 
polynomial-time algorithm which allows to efficiently calculate the min-cut value between a 
S - D pair, and to achieve this value using simple operations at relay nodes. 

To construct our algorithm, it is easy to see that, attempting to directly extend the Ford- 
Fulkerson (FF) algorithm [2}, or other path-augmenting algorithms developed for graphs, is 
not straightforward. Indeed, assume that in Fig. [2] we have at a first iteration identified the 
path highlighted in bold. The FF algorithm may attempt to employ the path consisting of 
the edges (x^ys), (X4,y7), (xy, jg), which in fact is vertex disjoint (excluding the S, D nodes) 
from the already identified path. However, because edges (x3,y(i) and ix4,yj) are LD, this 
path cannot bring innovative information to the destination; in fact, the min-cut value in this 
network equals one. Given that channels can interact in multiple ways, it is not clear that a 
polynomial algorithm does exist. 

Even in regular graphs, the number of cuts between an S-D pair is exponentially large. 
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However, polynomial time algorithms do exist in that case. One way to understand this is 
by observing that, in the FF algorithm for example, we are allowed to make "mistakes" 
when selecting a path, where a mistake in this case is when a path crosses a minimum 
cut more than once. The strength of the algorithm comes from the fact that such mistakes 
can be "corrected", by allowing to use employed edges in the opposite direction. What these 
corrections do is effectively "rewiring" already identified partial-paths. For example in Fig. [31 
a first iteration identifies the path that uses the edges AB, BC and DE. This path crosses a 
min-cut twice. A subsequent iteration can use edge CA in the opposite direction to find a 
new S-D path. This amounts to, no longer using edge BC and having two rewired paths: The 
first part of the first path arrives at node B, and is then complemented by the second path 



Min Cut 




Fig. 3. Correcting a "mistake" in the Ford-Fulkerson algorithm can be thought of as "rewiring paths". 

from B to D. The second path arrives from S to E, and from E to D is complemented by 
the first path. 

In deterministic networks, we cannot avoid making "mistakes" when selecting which paths 
to use, where now a mistake amounts to using the wrong edges between a set of linearly 
dependent edges; thus, to find a polynomial time algorithm, we need to put in place some 
simple mechanisms to "correct" such mistakes. As we will see in following sections, now 
using edges in opposite directions is no longer sufficient or helpful; we may in fact have to 
"jump" across nodes, and change the inputs or outputs employed by already identified paths. 
The interesting and surprising point is that, there exists a method to perform such corrections 
in polynomial time, and thus, no "mistake" is catastrophic. 

We close this section by noting that in H, it was observed that to study coding strategies 
and achievable rates, we can reduce an arbitrary network into a layered network, through a 
time-expansion technique, with asymptotically no rate-loss. Thus in this paper we will also 
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focus our attention in layered networks, which will be defined formally in the next section. 

This paper is based on the work in [fTTll . The algorithm in [fTTll was presented over binary 
fields. Moreover, the proof of the algorithm presented in [[TT]| applies under some assumptions 
on the structure of the linear dependency between inputs and outputs. In this paper, we provide 
a simple modification of IfTTTl that holds with no assumptions on the linear dependency of 
the channels. Moreover, we present the algorithm over an arbitrary finite field F,^. The paper 
in [ fTTI was followed up by a very nice connection with matroids and the development of 
alternative algorithms for this problem [fT2l| . 

This paper is organized as follows. Section HI] introduces our notation and basic definitions. 
Section UIl] describes our algorithm, provides a number of examples, and proves that it 
identifies a minimal value cut. Section |W] concludes the paper. 

II. Model and Definitions 

In this section, we start by defining the layered deterministic network model for a unicast 
connection over a network. 

Definition 1: (Layered Deterministic Network). A layered deterministic network model 
over a finite field F^, consists of a set of nodes and a set of channels (or edges) with the 
following properties: 

1) Each node consist of two sets, the set of inputs and the set of outputs of the node. We 
will generally denote inputs using the variable x and outputs using the variable y. We 
will denote by A{x) and A{y) respectively, the node where input x (output y) belongs 
to. Let I total be the total number of inputs in the network and O total the total number of 
outputs in the network. 

2) The nodes of the deterministic model are partitioned in parts. Each part is called a 
layer of the network. We assume that each layer has at most M nodes, and denote by 
Vi the set of nodes in layer /. The layers are labeled by / = 1, 2, . . . , A, where A is the 
number of layers. 

3) Layer 1 and layer A each has only one node in it. The node of the first layer is called 
"source node" and is denoted by S and the node of the last layer is called "receiver 
node" and is denoted by D. The source node has only outputs and the receiver node 
has only inputs. 

4) Each channel is a link between an input of a node in layer i to an output of a node 
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in layer i + 1 where 1 < / < A - 1. A fixed nonzero value over a finite field is 
associated with each link. 

5) Let X denote a vector that collects all inputs in layer /, and y a vector that collects all 
outputs in the next layer /+ 1. Then these vectors are connected through a given linear 
transformation over F^, i.e., y = Tx, where each nonzero value in the transformation 
matrix T corresponds to a channel and its associated value. □ 

We can define a transformation matrix between an arbitrary subset of inputs and outputs 
in adjacent layers. Let V be a subset of all inputs in layer i and V7 be a subset of all outputs 
in layer i + 1 (for simplicity we do not include the / indices). 

Definition 2: (Transfer Matrix). We define T(y, W) to be the matrix whose rows are labeled 
with the elements of V, the columns with the elements of W and the entry (v, w) is nonzero 
if and only if there is a channel between input v and output w. T(V, W) is called the transfer 
matrix between V and W. □ 

We will describe the extension of a given transformation matrix T(V, W) by adding a 
row corresponding to an input x ^ V sls T({V,x},W) and the extension by adding both a 
row corresponding to an input x and a column corresponding to an output y (not already 
contained in V and W) as T({V,x},{W,y}). 

The maximum information S can send to D depends on the minimum cut value in the 
network, defined as follows. 

Definition 3: (Cut and Cut-Value) By an S - D cut 'Vc we mean a partition of the nodes 
into two parts 'Vi and 'V2 in such a way that S e 'Vi and T e 'V2. We define the value of 
'Vc to be rankT(Ai,A2)log2^, where rank refers to matrix rank, Ai is the set of all inputs 
in the nodes in 'Vi, A2 is the set of all outputs of the nodes is ^2, and q is the size of the 
employed finite field. The minimum cut value equals mm^prankT(Ai,A2)log2^, where the 
minimization is over all S - D cuts. □ 

We will sometimes distinguish between a layer-cut and a cross-cut. There exist exactly 
A - 1 layer cuts, one between every two consecutive layers. For example, the 7-layer cut is 
•Vi = Vi U . . . U and 'y2 = V'^+i U . . . U Va for 1 < 7 < A - 1. A cross-cut involves several 
layers. The transfer matrix for a cross-cut is block diagonal, with the nodes in each layer 
belonging in a different block. 

Next, we will define the notion of linear dependency between channels. 
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Definition 4: (LI and LD Channels). Suppose that // is a subset of channels between layers 
i and / + 1 . Let V be the set of all inputs that are the head of a channel in H and W be the 
set of tails of these channels. We say // is a set of Linearly Independent (LI) channels if 
rankT(V', W) = \H\. Otherwise we say // is a set of Linearly Dependent (LD) channels. □ 

Our algorithm will send information from S to D using S - D paths, defined in the 
following. Through every path S sends one symbol over to D. 

Definition 5: (S -D Path). An S -D path is a disjoint set of edges (ei, ^2, • • • , ^a-i) where 
ei starts from S, Ca-i finishes at D, and e, finishes at the same node where edge e,+i starts. 
All S - D paths have the same length A - 1, because of the structure of the layered network. 
□ 

Essentially, selecting paths amounts to appropriately selecting sets of inputs V and outputs 
W to be used in each layer. To ensure that the information send through difi'erent paths can 
be decoded at the destination we need to use linearly independent (LI) paths, defined as 
follows. 

Definition 6: (Ll-Paths). Suppose that f is a set of 5 - D paths. We say these paths are 
linearly independent if and only if the set of edges of these paths in every layer form a set 
of linearly independent edges. □ 

Note that each x and y can take part in at most one of the LI paths; in this case we will 
say that it is used by that path. That is, we will say that a channel input x is used, if there 
exists a path that uses a channel (x,y') for some y'. Similarly, we will say that a channel 
output y is used, if there exists a path that uses a channel {x',y) for some x'. 

III. The Unicast Algorithm 

A. Main idea 

In our algorithm, we will find linearly independent paths one after another, in iterations. 
The first iteration identifies a path Pi. This is always possible if the source is connected to the 
destination, otherwise the capacity is zero. Each subsequent iteration identifies an additional 
path such that all selected paths are LI (as by definition |6l). For example at iteration ^ + 1, 
the algorithm takes as input the LI paths P = {P\, . . . ,Pk} and attempts to find path Pk+i 
such that the paths {Pi, ... ,^^+1) are also LI (as by definition [6l). Each iteration finishes 
once we reach the destination. The algorithm stops when an iteration cannot complete, at 
which point the algorithm outputs the set of identified LI paths P. 
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To find a new path, we start from the source and select one channel at each layer until we 
reach the destination if possible. At each layer we need to select a valid channel, in the sense 
that it is linearly independent from the set of the channels of the identified paths in that layer 
in previous iterations. A main tool that we use to achieve this is that we allow the algorithm 
to perform some type of "rewiring" inside one layer at a time. Assume for example that we 
have ^ + 1 "partial" paths from the source to nodes in layer i, and K "partial" paths from 
nodes from layer z + 1 to the destination. Rewiring refers to that we change the mapping 
between the starting and finishing paths by changing the channels we employ, while still 
preserving LI across the Mayer cut. These rewiring are achieved through two functions, the 
L-function and the 0-function, which we describe in detail later. 

Note that, instead of selecting channels (or paths), we can equivalently think of our 
algorithm as appropriately selecting a subset of inputs and outputs to be used in each layer. 
Each node internally simply maps each of its used inputs to a used output (the specific 
mapping is not important). That is, selecting K paths amounts to selecting K inputs t/^ at 
each layer i and K outputs Uy at the corresponding layer i + 1 such that the transfer matrix 
T; = T{Ux, Uy) is full rank for each i. 

Each of the LI paths that the algorithm outputs will be used to convey an independent 
symbol over the field from the source to the destination. Let x collect the K used outputs 
of the source and y collect the K used inputs of the receiver. The overall transfer matrix 
T = Ti ■ T2 . . . Ta-1 is full rank and therefore x can be recovered at the receiver by solving 
the system of linear equations 

y = Tx = Ti T2 . . . Ta-iX. 

That is, although we send one symbol through each path, due to the linear combining the 
deterministic model imposes, the receiver will still need to solve equations to retrieve the 
data. By the choice of paths, that is, by selecting at each node the edges we use to collect 
and transmit information, we preserve the "degrees of freedom", the number of independent 
linear equations the receiver decodes. 

B. Algorithm Description 

Assume we are at iteration ^ + 1, that takes as input the LI paths P = {Pi, . . . ,Pk} and 
attempts to find path Pk+i such that the paths {Pi, . . ., Pk+\] are also LI (as by definition [6l). 
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During this iteration, we explore nodes, starting from the source node S. We will use 
the terminology of exploring a node A to indicate that we have found a path from 5 to A 
(LI from the paths in "P) and attempt to continue this path from node A to D in order to 
complete Vk+i- Note that which input e A we use to reach the node A does not play a 
role; to explore a node it is sufficient that we arrive at it using any of its inputs. Once we 
reach a node, we mark the node as visited, and attempt to explore all edges emanating from 
it, as potential candidates for the path Vk+x. We use an indicator variable A\ with values 
{T, F}, to mark whether a node or edge has been explored (T) or not (F). We need explore 
(according to operations to be defined) each node during each iteration at most once, and we 
will do that calling a function Ea- Exploring a node reduces to exploring all unused inputs 
that it contains; exploring an input is achieved by calling a function E^. Each edge may be 
explored during each iteration multiple times, for reasons we will explain in the following, 
but no more than a finite number of times. This ensures that each iteration terminates after 
a finite number of steps. 

Assume that we have found a partial path Vk^i from S to a node A in the Mayer and 
we explore input jc, e A, with the goal of extending the path Vk^i to the i + 1 -layer. Let 
U = {{Xi,yj)} denote the set of K used edges in the i-layer cut, and Uy denote the set of 
used inputs and outputs respectively, and T{Ux, Uy) be the ^ x ^ full rank transformation 
matrix associated with U. We describe the steps we take to explore a specific input in the 
following. We illustrate these steps through a number of examples in Section IIII-CI 

Steps in exploring input Xi at node A 

1) If Xi e Ux, i.e., x, is already used by a path, do nothing. Note that although node A 
will be marked as explored (M{A) = T), this particular Xi e A will not be marked 
{M(Xi) = F will remain). 

2) If Xi i t/.v, i-e-, y^i is not used, then for each yj, such that the channel {Xi,y^ exists, we 
distinguish two cases. 

a) yj i Uy, i.e., yj is not used. Consider the {K-\-\)x{K-\-\) matrix T({[/v, [Uy,yj]) 
associated with the used edges and the new edge {Xi^yj). We again consider two 
cases. 

i) If the matrix T{{Ux,Xi}, {Uy,yj}) is not full rank, do nothing. 

ii) If the matrix T{{Ux,Xi},{Uy,yj}) is full rank, use edge {Xi^yj) to go to node 
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A(yj). If this node has not been visited before, we attempt to continue from 
node A(yj) by calling the function EA(G,'P,M,A(yj)). 

Additionally, for each yk e Uy, with A(yk) = Aiyj), perform what we call the 
^-function. The idea is that, in this case there exists a path from the source 
to the destination identified during a previous iteration that goes through node 
A(yj). This path uses an edge {xk,yk) & U to reach node Aiyj). We can then use 
our newly identified partial path that uses the edge {Xi,yj) to reach from the 
source the node Aiyj), and "connect" this new partial path with the existing 
partial path from A{yj) to destination. Thus, we have the opportunity to again 
perform rewirings and visit new nodes. 

More precisely, the 0-f unction performs the following. Remove from the ma- 
trix T({Uj(,Xi},{Uy,yj}) the column corresponding to yt with A(yk) = A(yj). 
Let 

C^T({U„Xi}AUy,yj}-{y,}) 

denote the resulting (K + \) x K matrix. Consider each of the K square 
submatrices of C resulting by deleting each of the first K rows. Let Cm denote 
the submatrix resulting from deleting row x„„ i.e., 

C„ = T({Uj„Xi} - {xj, {Uy,yj} - {yt}). 

If C,„ is not full rank, do nothing. If it is full rank, perform a rewiring of the 
existing K paths using C^- If A{Xm) is not marked as visited, explore A{Xm)- 
If A(Xm) is marked as visited, then explore input x,„ even if it is marked. Note 
that the 0-function may be executed at most as many times as the number of 
outputs in that layer, and thus when it is executed, at most K already visited 
inputs might be revisited. Examples [SMI illustrate the use of the function. 

b) yj e Uy, i.e., yj is used. We can then not immediately use the channel (Xi,yj), 
unless we perform some rewiring. This rewiring is captured by what we call 
the L;f-function. This function will be executed at most once for every input. To 
ensure that, we keep in the algorithm for each input an indicator variable MJl 
with values {T, F}. 

The L;j-function operates as follows. Consider the extended transformation matrix 
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T({Ux,Xi},Uy). Define L^, c Ux to be the smallest subset of Ux, of size \Lxi\ = 
s < K, such that the matrix T{{Lx.,Xi}, Uy) has rank s. Using proposition [2] this 
set can be identified in polynomial time. Proposition [3] proves that removing any 
one of the rows of T{{Lxf,Xi}, Uy) still results in a full rank matrix. Equivalently, 
removing any row of T{Ux, Uy) corresponding to a xj- e Lv,, and substituting it 
with the row corresponding to Xi, results in a full rank matrix, that can be used to 
rewire the paths identified in the previous iterations. That is, using Proposition [H 
we can use the row T{Xi, Uy) to substitute any of the already employed T{xk, Uy), 
Xk e Lv, that are LD with Xi row, while still maintaining the same number of paths 
as identified from the previous iterations. We will then be left with a partial path 
arriving at the node A{xk), and we can attempt to use any of the available x's in 
this node to proceed. We now distinguish to subcases: 

i) A{xk) is already marked as explored. In this case we will not visit this node 
again. However, we will explore input Xk, although this input might have been 
explored before. Note that, at each execution of the function, at most K 
inputs will be re-examined. 

ii) A{xk) is not marked, i.e., during this iteration we visit this node for the first 
time. Then the algorithm explores this node. Additionally, if there exists a 
path identified during a previous iteration that utilizes (at the previous layer) 
an output y' at node A{xk) we will execute on this node the ^-function that 
we described previously. 

Examples [T] and |4] illustrate the use of the Lj|.-function. 
The previous steps are the main ingredients of two recursive functions and Ex that 
implement our proposed algorithm and are summarized in Table HI The first function. Ex, 
checks if we can continue from a current input x to reach the destination by a sequence of 
channels which are linearly independent to the previous identified paths. The input of this 
function is the network, a family of identified paths and already visited nodes and current 
input. It returns true if there is a sequence of channels with the described properties and 
returns false, otherwise. The second function, E^, does a similar job as the first function 
except that it works for the current node instead of the current channel. So, as one might 
guess, this function, essentially, calls the first function for all of its inputs and if none of 
them returns true, it also returns false. We illustrate the algorithm steps through a number of 



12 



examples in Section IIII-CI 



Three Propositions Used in the Algorithm 

We here provide some useful propositions that were used in our algorithm. The first is a 
known property [9], that allows to "match" inputs and outputs through LI channels, and that 
that we repeat for completeness. 

Proposition 1: If the K x K binary matrix T{Ux, C/y) is full rank, then there exist K LI 
edges with x e Ux and y e Uy. 

Proof: Since T(i7^, Uy) is full rank matrix, it has nonzero determinant. Now if we 
expand the determinant using the sum of product- expansion, we should have at least one 
non-zero product and this product corresponds to a perfect matching in the bipartite graph 
with adjacency matrix T{Ux, Uy). ■ 

Proposition 2: Let T(i7v, Uy) be a full rank K x K matrix and x, = T(Xi, Uy) a vector 
in its span. Then, we can find the smallest L^. Q Ux of size s = \Lx-\ < K such that 
rank(T({Lv., JC;}, Uy)) = rank(T(Lv,, Uy)) = s using 0(K^) operations. 

Proof: Since the matrix A = T{Ux, Uy) is full rank, there exists a unique vector c such 
that X, = cA. Solve these equations to find c. Lv, are the indices corresponding to nonzero 
values in c. ■ 

Proposition 3: Let L^, be the smallest subset of Ux, |Lv, | = s, such that rank(T({L;c., x,}, Uy}) = 
rank(T(Lv,, Uy)) = s. Then for each xj e Lx,, rank(T({L;i-. - xj, Xj}, Uy}) = s. 

Proof: Consider the vectors Xy = Tixj, Uy). From minimality of Lx-, x, = Yjjet,. (^j'^j with 
aj 0, otherwise, we could have found a smaller set to replace Lx.. Thus, for any x^ 6 Lx., 

Xi = fikXk + ^ j3jXj 

for some nonzero coefficients yS's over the finite field. Since the vectors {xy} with xj e Lx^ 
are LI, and since given x, and all other Xy apart x^. we can still retrieve x^-, the matrix 
T({L_t_ - Xj, Xi}, Uy}) has full rank. ■ 

C. Examples 

Example 1: Exploring an input and the Lx-function. Consider the layer cut in the left 
Fig. |4] and assume that, during iterations 1 and 2, we have identified the two LI paths f i 




Fig. 4. Assume that bold depict edges in paths 'Pi, identified through previous iterations. At iteration 3 a 
partial path 'P3 arrives at node A4, and we explore the edge {xs,y\). We perform rewiring using the function. 
Left: marked nodes and paths before the function. Middle: marked nodes and paths when substituting X4 
with X5. Right: marked nodes and paths when substituting x-}, with X5. 



and ^2 that use the bold edges in the figure. Thus, 



U = {(X3,yi),ix4,y3)}, f/x = {^3,^4}, Uy = {yuy^}, T(C/^., Uy) 
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X4 



yi ys 
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In iteration 3, assume that we reach node A4. We mark this node as visited, and examine the 
channel input X5. There are three possible edges we need to explore: {(x5,yi), (xj, J4), ix5,y5)}. 
• We first examine the edge (x5,yi). This is depicted in the left Fig. |4l Since yi e Uy, we 
are at step (2 - b) of the algorithm. We thus consider the matrix 



T{{U,„xs},Ud 



X3 
X4 

X5 



yi 


J3 




1 


' 1 





1 


. 1 






and find the set L^^ = {x3,X4.}. 

We can attempt to substitute each of the x e with X5. 
- If we substitute X3, we mark A2 and find another matching: {(xj,}^!), (^4, J3)}. This 
is depicted in the middle Fig. IH Since it is the first time we visit node A2, and 
since there is path arriving at it, we will perform the 0-function at this node. We 
will not describe these steps here, see for such a case example \TT\ We then call 
"P, Al, A2). Assume this function returns F, i.e., fails to find a path to the 
destination. We restore the original path matching and continue. 
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Fig. 5. Continuing from the example in Fig. |4] Failing to use the edge (x5,yi), we will next explore the edges 
(xi,y4), and (x5,3'5). Left: marked nodes and paths. Middle: marked nodes and paths when exploring the edge 
ix5,y4). Right: marked nodes and paths when exploring the edge {X5,ys). 



- If we substitute X4: We mark A3 and find another matching: {fe, ji), (^3, J3)}. This 
is depicted in the right Fig. |4l We again perform the 0-f unction at node A3, bit 
described in this example. We then call £'(G, f , A1, A3). Again assume it fails to 
find a path to the destination. We restore the original path matching and continue. 

We proceed with (-^5,^4), as depicted in the middle Fig. [51 Since y4 ^ Uy, we examine 

the rank of the matrix 



Because rank(T({i7;t5 -^5}, {Uy,y4})) = rank(T(i7;t5 Uy)) = 2 we are at step (2 - a - i) of 
the algorithm, and we do not need to take any actions. 

Finally, for the edge (.fs, js), with ys i Uy, we examine the rank of the matrix 







J3 


J4 




' 1 


1 


0^ 







1 


1 


X5 


. 1 





1 . 







J3 


J5 


X3 


' 1 


1 


0^ 


X\ 





1 


1 


X5 


.0 





1 . 



T({[/„X5},{t/v,y5}) 



Since rank(T({t/;f, .^5}, {f/v^Js})) = rank(T(i7;i-, Uy)) + 1 = 3, we are at step (2 - a - ii) of 
the algorithm, and we can use the edge {x=„y^ in the path V^. We thus mark node £4 
as visited and continue from there. 

That is, we update f, and we call the function E{G,V, hA^B^). Note that since P\ and 
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Fig. 6. Continuing from the example in Figs. |4]and|5] 



V2 do not use node £4, we will not perform the 0-function at this node. This is depicted 
in right Fig. [5l 

□ 

We next provide two examples for the 0-function. 
Example 2: First example for (p-function. 

Continuing the previous example, assume that we have failed to find a path when exploring 
A4. Suppose that the algorithm continues and suppose that, through some different path, we 
reach and mark node Ai, as depicted in the left Fig. [6] (we maintain the marked nodes from 
the previous algorithm steps during this iteration). We will now explore inputs x\ and X2- 

Assume we start by edge (^2, ^2)- We can use this edge to reach and mark Bi, as depicted 
in the middle Fig. [6l Since this is the first time we visit node 5i, we will perform the 
0-function. 







J3 


x^ 


' 1 


1 


X4 





1 


X5 


.0 


1 



T(C/, U {X2}, V, U {y^} - {yiD = T({X2,X3,^4}, {J2, J3}) 



Consider the transfer matrix where we remove the output 3^1, and use the inputs {x2, X3, x^] 
and the outputs {y2,y^\. Both submatrices T({x2, -^3}. {^2,^3, }) and T({x2, Xa\, {y2,y^, }) are full 
rank, and thus we can explore inputs Xa, and x-^ respectively. We will here describe the steps 
when selecting the submatrix T({x2, JC3}, {^2, J3, }• 

We find a matching for T{{x2.,x^\, {^2,^3, as depicted in the right Fig. [6l and proceed to 
examine input x\. Note that since node A3 = A{xa) is already marked, we do not need to 
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Fig. 7. 





explore it again. We observe that we can use the edge (x4,y4), and thus we mark node Bi, 
and we can further proceed from there. □ 
Example 3: Second example for (p-function. Consider the layer cut in Fig. |7l Assume 
during the first three iterations we have identified the paths depicted with bold edges, that is, 





y\ 




J3 


Xi 


' 1 


1 


0^ 


X2 


1 


1 


1 




.0 


1 


1 . 



V = {(Xi,Ji),(X3,>'3),(-^4,j4)}, = {Xi,X3,X4}, t/y = {jl,>'3,y4}, KJJ ^,IJ y) 



During iteration 4, we attempt to use edge {X2,y2). Since node B\ has not been used before, 
we perform the (/"-function. We thus consider the matrix 



X\ 

T({.X:i,JC2, JC3,JC4},{y2,y3,j4}) = X2 

X3 
X4 



yi y3 y4 

1 1 

1 

1 1 

1 1 



which has the full rank submatrices T({xi, X2, X3}, {y2,y3,y4}) and T({jci, JC2, X4}, {3^2,^3, ^4})- 
Using the T({xi, X2, X3}, {y2,y3,y4}) and the matching depicted in the middle Fig. Ul we can 
visit node A3 and explore input X4. Note that since A3 has not been visited before, we need 
perform the 0-function on the node A3 itself. 

If instead we start by utilizing the submatrix T{{xi,X2,X4},{y2,y3,y4}) and the matching 
depicted in the right Fig. |71 we visit node A2. Again, since A2 has not been visited before, 
we need perform the 0-function on the node A2 as well. □ 
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Fig. 8. Path Vi identified during the first iteration is depicted in bold. During the second iteration, path 
reached node A3. 



The next example illustrates how the algorithm runs and performs rewirings across several 
layers. 

Example 4: Example of rewiring across layers. Consider the network depicted in Fig. [8] 
and assume that the first iteration identified the path = {{X2,y2), {xj,,ye), x=„y())}. During 
the second iteration, path ^2 reaches and marks node A3, as depicted in Fig. [HI Assume that 
the algorithm then explores the edge (x5,);4) and performs the function. In this case we 
have that 



X4 
X5 



y4 
1 



and L, 



{X4}. 



We thus visit node A2 = A{x4.). Since it is the first time we visit this node, we perform the 
0-function at node A2. That is, at the first layer, where we now have 



U = {{xuy2),(x2,y3)], U^ = {xi,X2\,Uy = {y2,y3\, T{U^,Uy)= xi 

X2 



1 



we no longer need to use the output y2, and thus can explore inputs xi and X2. From X2 
we cannot proceed. From xi we can use the edge {xi,yi) and reach node Ai as depicted in 
Fig. |9l We do not need perform the function at Ai as there is no additional path using this 
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Fig. 9. Continuing from Fig. |8] Resulting configuration after performing the function for edge (x5,y4) and 
the 0-function at node A2. The potential path 7^2 now reaches node Ai. 



node. We proceed to explore the edge (X3,y4) and perform the function for xj,. 
Given that 



^ 1 ^ 



T({JC3,X5}, {Ja}) = X-i 
X5 

we proceed to re-examine X5. Because 



V 1 / 



and L 



•X5 



{X3], 



T({X3,X5]Ay4,y5]) 



X3 
X5 



y4 ys 
1 
1 1 



we can now use this edge and proceed to node B2- From node B2 we can use edge {x-j.yi) 
to reach the destination and complete path !p2- 

Note that this is the second time during this iteration that we examine edge (JC5,y5). The 
first time we could not use this edge, due to LD with the used edge (x4,y4). However, after 
the rewiring, the used edge in this layer became instead {x3,yA), which is LI from {x^,y^). 

□ 

Example 5: Operations over a non-binary field. Consider the network depicted in Fig. [TTl 
which is similar to the network in Fig. [21 only now there is a fixed coeflicient associated with 
each edge over F4. We assume that all these coefficients equal 1, apart from the coefficient 
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Fig. 10. Continuing from Fig.|9] Resulting configuration after performing the function for edge (x-},,y4), and 
continuing ^2 from node A3 to node B2 and D. 




Fig. 11. An example of a nonbinary linear deterministic network. Each edge is associated with a coefficient 
over F4. All these coefficients equal 1, apart from the coefficient associated with the edge {x4,y-i) that equals 2. 



associated with the edge (x4,j7) that equals 2. Operations are now over the field F4. For 
example, y-j = Ix^ + x^. 

Assume that the first iteration identified the path Vi = {(X2,y2), (X3,y6),{x5,y9)}. During 
the second iteration, assume that we use at the first layer the edge (x^yi.), and arrive at layer 
2. At this layer, Uj^ = {x^} and Uy = {y^}. To use edge {x4,y^), we examine whether the matrix 

T{{x3,x4},{y6,yi}) = X3 

JC4 



y6 




1 


1 


1 


2 
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Fig. 12. A layer-cut and (a) the traditional approach where interference is treated as noise, (b) the approach 
where interference is allowed. 



is full rank over F4. As indeed it is, we can reach node B2, and from there using edge (x6,j8) 
complete Note that in the binary example in Fig. [21 we could only identify one path. □ 
We conclude with an example that shows the benefits of not treating interference as noise. 

Example 6: Benefits from constructive use of interference. The traditional approach adopted 
today in wireless networks is that if one or more transmitted signals interfere with a received 
signal, they are treated as noise. Such interference is avoided through scheduling. This 
approach can lead to significant loss of capacity. Consider a network that has the layer-cut 
depicted in Fig. [121 Fig- [T2lfa) depicts the traditional solution: treating interference as noise 
implies that we cannot simultaneously have two broadcast transmissions that interfere, and 
thus we can have at most one broadcast transmission. Fig. [T^ b) shows that, if interference is 
allowed, we can in fact use four LI edges through this cut (the example is easily generalized 
to A'^ nodes leading to 0{N) benefits). Indeed, the transfer matrix associated with this cut. 



T({.JCi,JC2,JC3,JC4}, {Ji,j2,j3,j4}) = 



1 


1 


1 


1 





1 


1 


1 








1 


1 











1 



has rank four. This matrix coincides with the transformation matrix of the highlighted edges. 

□ 



D. Main Result 

Our main result is the following theorem. 

Theorem 1: The unicast algorithm identifies C LI paths, where C is the min-cut value 
between the source-destination pair in a linear deterministic network. 
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In particular, the number of the paths identified by the algorithm equals the rank of the 
transfer matrix between the inputs in Vi and the outputs in V2, where Vi are the marked and 
V2 are the unmarked nodes when the algorithm stops. 

Proof: Based on the algorithm, it is clear that when the algorithm stops, the provided 
output is a set of linearly independent source-destination paths P. 

Let K denote the number of these paths; this implies that the algorithm stops, i.e., fails 
to find an additional path, during iteration ^ + 1. Since K can never exceed the rank of a 
source-destination cut, i.e., ^ < C, it suffices to find a cut whose capacity is not bigger than 
the number of paths identified by our algorithm. Let Vi be the set of all marked (visited) 
vertices and Vj be the other vertices during iteration ^-1- 1, when the algorithm stops. Clearly, 
(Vi, V'2) is a source destination cut. 

Consider now the matrix T(Vi, V2), where, by a slight abuse of notation, the set of rows of 
this matrix correspond to the inputs x in Vi and the set of columns to the outputs y in nodes 
in V2 respectively. By appropriate ordering of these inputs and outputs we can bring the 
transfer matrix in to a block diagonal form, in which every block corresponds to a layer of 
the network. More precisely, if Wi (W-) is the set of visited (unvisited) nodes in the z-th layer 
then T(Vi, V2) can be regarded as a block diagonal matrix whose z-th block is T(V7,, W.^^). 
For clarity we have collected all the notation we use in this proof in Table IIH-DI 

We will show in Lemma [U that for every integer 1 < z < A it holds that, 

rank(T(W,-, W^,)) < 

(1) 

\{e = vv' e E(G)\v e Wi,v' eW'i^i,ee U}\ - \{e = vV e E{G)\v e W'i,v' e WM,ee U}\ 

where recall that we denote by U the set of used edges by paths in P at layer z. That is, if 
e e U, then it belongs in some path j, i.e., e e Pj (and more generally e belongs in the set 
of all used edges in the graph, i.e., e e P). Also, from the structure of the layer network, the 
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total number of paths equals the number of used edges in each layer, namely, \U\ = K. Now 
rank(T(yi,V2)) 

A 

^=^_^rank(T(W„W;,i)) 

i=\ 

(b) (2) 
< \{e = vv'lv is visited but v' is not visited, e e !P}| - \{e = vv'\v is not visited but 

v' is visited, e eP}\ 

Equality (a) holds from the fact that the rank of any block diagonal matrix is the sum of 
the rank of its blocks. Inequality {b) follows directly from Lemma [H that will prove in the 
following. Finally, equality (c) holds because for each source-destination path "P, the "used" 
edges by f ; contribute exactly one in the difference, that is, 

\{e = vv'lv is visited but v' is not visited, e e ^,}|- 

(3) 

- \{e = vv'lv is not visited but v' is visited, e e ViW = 1 

Indeed, given a cut (Vi, V2), with S e Vi and D e V2, for !P, to connect S to D, it must cross 
at least one time from Vi to V2. If it crosses m > 1 times from Vi to V2, then it also has to 
cross m - 1 times from V2 to Vi. ■ 
Lemma 1: For every integer 1 < / < A it holds that, 

rank(T(W^,-, W^,)) < 

(4) 

\{e = vv' e E(G)\v e Wi,v' eW'i^y,ee U}\ - \{e = vv' e E(G)\v e w;,v' e e U}\ 

Proof: Fix an integer 1 < / < A. Recall that we denote by U the set of used channels 
in this layer (dropping the index i for simplicity), U^, their inputs and Uy their outputs. 
Additionally, let Ubx be the set of all the inputs of the nodes in Wj and U'^^ be the set 
of all the visited inputs in the current layer which appear in some identified path. That is, 
^Bx ~ ^Bx ^ Ux- Let Usy be the set of all the outputs that are in the i + 1-st layer and are 
not visited and U'g^ be those outputs of Usy which appear on some identified path (i.e., used 
outputs). That is, 11'^^ = f/sy n Uy. The notation is summarized in Table UlLDl 

We are interested in calculating the rank of the matrix T(V7,-, W'.^^) = T{Ubx, Usy)- Note 
that we can split the columns of T(t/fo, Ugy) into two parts, one corresponding to the used 
and unmarked outputs, i.e., U'^^,, and the other corresponding to the unused and unmarked 
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outputs, Usy-Ug^,. Similarly, we can split the rows again into two parts, one corresponding to 
the used and marked inputs, U'^^, and the other to the unused and marked inputs, Ugx - U'^^. 

Our proof proceeds as follows. Lemmas [3] and |4] prove that all the rows of T{Ubx, Usy) 
that belong to the second part (in Ubx - U'^^ ) are in the span of the rows corresponding to 
the inputs in the first part (in U'^^. As a result, 

rankT([/5,, Usy) = rmmu's,, Ub.). (5) 

Lemma [5] builds on this result to prove that 

rankT([/B,, Usy) = IC/^I - (\Uy\ - IC/b.I). (6) 

Showing that ^ holds is the main technical part of this proof. Now we distinguish three 

cases for each edge e = (x,y) e U: 

I) X e U'g^ and y i {Uy - U'^^}: the edge contributes value "one" only in IC/g^l, 
1) X i U'g^ and y e {Uy - U'^y}'. the edge contributes value "one" only in (\Uy\ - If/^^J) 
3) X e U'g^ and y e {Uy - U'^^}: then the edge contributes value "one" both in lU'^J and in 
i\Uy\ - |f/g^|) and thus does not affect the quantity \UgJ - (jUy\ - lUgJ). 

Thus 

mj-(\Uy\-\U',y\) = 

\{e = vV e E{G)\v e U'^,, V e U'^y, eeU}\- \{e = vV e E{G)\v i U'^,, V e Usy, e g U}\ 

= \{e = vv' e E{G)\v e Wi,v' eW;^i,ee U}\ - \{e = vv' e E{G)\v e w;,v' e e U}\ 

and our proof is concluded. ■ 
Before we continue, we need to introduce some additional notation. 
When iteration ^ + 1 starts, at the layer we are examining, we have identified from the 
previous iterations a set of used edges U, with corresponding set of inputs and outputs Ux 
and Uy respectively. As the algorithm attempts to find the ^ + 1 path, it may perform some 
rewirings inside this layer (due to consecutive executions for example of several and ((>- 
functions). Thus, when input jc, gets marked and starts to be explored by the algorithm, this 
input might perceive as used a diff"erent set of edges than U. We will denote by fi!-'^ the set 
of edges that input jc, perceives as used (by the K paths), and the corresponding sets 

of used inputs and outputs. Note that, while all the edges emannating from Xi are examined, 
for all of them the algorithm will assume the same set of used edges 'R^'\ 
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Now, from assumption, the iteration ^+1 fails to find a path from S to D. Thus, although 
several rewirings might be attempted, because iteration ^ + 1 fails, when the algorithm stops 
we have reverted to the original set U. 

Lemma 2: For all gUbx- U'g^ it holds that 

rankT({^®, xt}, {'R^K Usy - U'^y}) = rankT(^®, Usy - U'^y}) 
In particular, there exists a minimal set of rows L^^ Q such that 

rank(T({L,„ xa, U^y - f/^,})) = rank(T(L,„ {^f , Usy - f/g,})). (7) 

Proof: For this proof only we also use the following notation. Assume that rank(T({^^'^ x,}, 
rank(T('^'^'\ Z)) for some set of columns Z. Define Lx^iZ) to be the smallest subset of 
that contains jc, in its span, i.e., 

rank(T({L,,(Z),xa,Z)) = rank(T(L,, (Z),Z)). 

We will use for abbreviation Lx^ = Lx-CRf). 

Decompose the column indices of the matrix T('R.x\ {f^K Usy - U'sy)) iii the following 4 
nonoverlaping parts: {l^f, W]_, Wl, Wq]. Here 

• ^y contains all the used y's, 

• Wi contains all yj such that the edges (x„ yj) exist but cannot be used due to LD, 

• Wl contains all the remaining yu, G Wbj that have at least one nonzero value in each column 
(i.e., the set of all y columns where at least one edge {xk,yk) with Xk g Lx^iWBy) exists, but 
Xi has zero value), and 

• Wo contains all zero columns (this is the set of j's associated with jc's not in the set 

{Lx,{WBy),Xi}). 

We underline that the set of columns UBy- Ug^ = {Wi, Wl, Wq} is the set of unmarked 
unused outputs at the end of the iteration ^ + 1, and is the same independently of the set 
of outputs in l^y. Note that, because can contain either outputs that belong in Uy (that 
thus are used) and/or outputs obtained through the execution of the ^-function (and thus are 
marked), has by definition zero overlap with the set UBy - Ug^ which contains outputs that 
are both unmarked and not used. 
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To prove the lemma, it is sufficient to prove that the following equation holds. 



(8) 



(a) : To prove (a) we need to show that Lx^if^y) = Lx.(f^\ Wi), that is, 

rank(T({L,„ X,}, W,})) = rank(T(L,„ {'Rf, W,})). 

Since the matrix Tilif ,1^}) is full rank, the row T{Xi,f^y) belongs in the span of this 
matrix, and thus there exist nonzero coefficients {aj} in such that 

T{xi,'R^)= Yj «yT(-^i'^f)- (9) 

Note that for each yj e Wi, there also exist nonzero coefficients {/3j} in F^^ such that 

rank(T({^® , xt}, {'R^\ yj}) = rank(T(7?«, mf,yj}) (10) 

otherwise the node Aiyj) would have been visited and marked and yj i W\ . Thus T(;c,-, {'R!^\ Wi }) 
belongs in the span of TCRf, {Kf, Wi}), and 

T(X,-, W,}) = ^J^^^P {^5- ^iD- ^11) 

xyeL,..(<",lV,) 

Expurgating from both sides of (fTTI) the columns of Wi results in an equation that still 
holds for the expurgated vectors and has only columns corresponding to 'Ry\ From LI of all 
vectors T(x, 'R^\ x e nf, none of these expurgated vectors is identically zero. Moreover, 
from minimality of L^-CRy'') the expansion ^ is unique. We thus conclude that aj = /3j and 

(b) : We will now argue that L,, (!^.®) = L.Xi'R-yK Wl]). Consider a specific yk e Wl that 
has a nonzero value in a row Xk e Lx.. That is, there exists an edge {Xk,yk) with x^ e Lx. and 
yk e Wl. 

During the algorithm, we will at some point "release" xt from the set of used edges and 
replace it with x,. We will then attempt to explore Xk, assuming the set of used edges K^'K 
Note that Xk might have already been explored before using a different set of used edges 
'R'^'^K However, our algorithm will for each explore all inputs in the set L^. using 'R'-'^ again, 
even though these might have been explored before. 
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If the matrix T({'R.^:!.\xi},{'R.y\yk}) is full rank, then the node A(yk) will be visited and 
yi, t Usy which is a contradiction. Thus the matrix T({'R.x\ Xi), {'R!^\yk}) is not full rank. 
Consider then the set L^.{['R.y\yk}). Applying a similar argument as in (a), we have that 

T(Xi,'R^^^)= J] «yTU-,!R«) (12) 

x;eL,,CK<.'*) 

and 

T(xi,mf,yk})= Yj fijT^(^!c,mf,yk}). (13) 

Expurgating the column corresponding to yj, we conclude that L^X'^f ^ iyk)) = Lx.CRf). 
Repeating for all yt e Wl concludes (b). 
(c) : Clearly it also holds that 

rank(T({L,„ X,}, ^^'^)) = rank(T(L,„ {Kf, Wo})), 

which concludes the proof of this lemma. ■ 
Lemma 3: For each Xj e Ubx - U'^^, the vector T(xi, {tlf , Ubv - U'sy)) belongs in the span 
of the matrix T{U'g^,{'Uy^ ,UBy - U'^^}), where denotes the set of unmarked outputs in 
the set Uy. 

Proof: Note that all unmarked outputs in Uy are included in IR®, and thus, ^ff c 'R^^nUy. 

Order the inputs 6 Ubx - U'^^ according to the order with which they are for the first 
time visited. That is, Xi is the first unused input that is explored inside layer i and during 
iteration K + \, X2 the second one, etc. We will prove our claim through induction. 
Induction Step 1: When xi, the first input, gets visited, clearly "R^^^ = U, and Uy^ = Uy since 
to perform a rewiring using a new output, we need to have already explored at least one 
input. From lemma [2l we know that the vector T(xi, {Uy, UBy - U'^^}) belongs in the span of 
the matrix T(i7^, {Uy, UBy - U'^^]) and in particular from (|7]) belongs in the span of the matrix 
T(L,,,{[/,,[/e,.-t/^,}). 

It is then sufficient to prove that the inputs in Lj^ belong in marked nodes, i.e., c U'g^. 
But this holds, because of the algorithm steps when we visit Xi. In particular, when xi is 
explored, all nodes with x e L^^ are visited, marked, and explored assuming the set of used 
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edges U. Thus L^^ Q U'^^, and 

rank(T({f/^,, x,}, {Uy, U^y - U'j^y}) = rank(T(f/;„ {Uy, U^y - f/^,}) (14) 



Induction Step k: Assume that for 1 < / < T(jc,, {l/f, Ugy- U'ey)) belongs in the span of 
the matrix T{U'„^, {1/®, Usy - U'^y]). 



Induction Step k+1: From lemma [2l we know that the vector T{xk+i,[f^y^^\UBy - U'^^,}) 



belongs in the span of the matrix T{'Rf'*'^\ {'Rf'*'^\ UBy - U'„]), and in particular in the span 



'Bv' 

of the matrix T(Lf^^\ [l^y^^K Ugy - t/g,}), where 4^^^' c Removing the columns that 

,^ ISIr^xx; q11 V J ^^'^^^ cirt=* \ricit/^r\ 
By I 

For each such x, if x e U^, then x will appear in U'^^. If on the other hand x e 'R^'^^^ but 
X i Ujc, then x is one of {xi, . . . , JCyt} since 7??^'^ can only differ from Ux on marked inputs. 
From induction, for each Xi e [xi, . . . ,Xk} the row vector T(jc,-, {'Uy \ Usy - U'^^}) belongs in 
the span of the matrix T([/^^, n Uy, Usy - U'j^y}). Moreover, c ^{^, i < k + I, 

since, if some outputs are unmarked during iteration ^ + 1, they also are unmarked during 
the previous iterations. This concludes this proof. ■ 
Lemma 4: In the matrix T(UBx,UBy) each row corresponding to unused marked inputs, 
i.e., Xi e Ubx - U'^^, is in the span of the rows corresponding to inputs in U^^, and thus 
rmkTiUBx, UBy) = rankT(t/^^., [/b,)- 

Proof: From Lemma [3l for each Xi e UBx-U'g^,v/e know that the row vector T(jc,, {l/f, C/bj- 
f/g^}) belongs in the span of the matrix T(U'g,, C^/f , UBy - U'^^}). That is, 

T(x,-, , Usy - = J] ajTixj, UBy - t/fi,}) (15) 

for some aj 6 F^. Next, note that U'^^, is a subset of Hy^ for each /. This is because, at each 
rewiring, tly'' can differ from Uy only on marked outputs. But U'^^, is the set of used and 
unmarked outputs, and thus U'^^ Q 'tly\ Removing some columns from both sides of (fTSi) 
we get that 

T(jCi, UBy) = T(X;, {U'sy, UBy - U'sy}) = ^ ajT^Uj, {U'sy, UBy - U'sy}) = ^ CtjTiXj, UBy) 

and the claim follows. ■ 



are not in Uy\ we get that the row T(xi+i, L^bj, - U'^^]) is in the span of the rows 
T{L^^^^\ {'Uy \ Usy - U'g }). Now, all x e Lf"^^^ are visited and marked during the algorithm. 
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Lemma 5: The rank of the matrix T{Ubx, Ub)) can be upper bounded as 
rankT(f/^,, f/^,) < - (|f/,| - |f/^^|). 

Proof: Consider the matrix A = T{U'g^,{Uy,UBy - U'^^}). This matrix has less rows 
than T{Ubx, Usy) as it does not contain the rows in Ugx- U'^^, and has more columns than 
T{UBx,UBy) as it contains the additional columns corresponding to the outputs Uy - U'^^. 
The idea in this proof is to gradually change matrix A, by sequentially adding rows and 
by removing columns, until we create the matrix T{Ubx, Usy), taking into account how each 
operation affects the rank. 

Order the marked outputs in Uy, i.e., the outputs in Uy-U'^y that we need remove, according 
to the time they got marked, i.e., y\ is the output that got marked first when node A{yi) is 
visited, the one that got marked second, etc. Now, assume that at the time when output 
y\ is visited, ji unused inputs (not in Ux) have already been visited and marked (note that 
ji > 1, if ji = it is not possible to mark yi). In general, when output y^ is visited, we will 
have that j/. inputs in Ubx - U'^^ are marked, with ji < < js ■ ■ ■ < jt and L = \Ubx\ - lU'^J. 

Our starting point is that the matrix A has rank \U'g^\, i.e., all its rows are linearly 
independent. Indeed, since the K x K matrix T(Ux, Uy) is full rank and U'g^ Q Ux, the 
rows T(U'g^, Uy) are LI, and as a result so are the rows TiU'^^, {Uy, Ubv - U'^y}). 

We are going to perform L = \Uy\ - |[/^^,| steps, creating a sequence of matrices {Aq = A, 
Ai, . . . ,Al} where at step k, k = I,. . .L, we first add to matrix Xk-\ the rows {JCjt_,+i . . .XyJ 
and then we remove the output y^ in {Uy - U'^^) to create the matrix A/.. 
Step 1: Removing output yy. 

Let "^^^'^ be the set of perceived used edges when y\ is marked. Since this is the first time 
an output in Uy is marked and the (p function is executed, l^yP = Uy, for all j < j[. 

We know from lemma [3] that the rows T(xi, {Uy, UBy - U'^^}), I < i < j\ belong in the span 
of the matrix T{U'^^, {Uy, UBy - U'^^]). Thus adding these rows to matrix A does not increase 
its rank. 

From lemma |6l there exist a set of rows S{y\) with S{y\) c {1^^^\x\, . . .,Xj^} such that, 
removing the column yi drops the rank of the matrix T(5(3;i), Usy - U'^^}) from |S(ji)| 
to |5(yi)|- 1. In other words, the column T(5(ji),ji) is LI from all the columns of the matrix 
T{S(y,),{1^f^ -y,,UBy-U'^^}). 
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Notice that when the node A(yi) gets visited during iteration ^ + 1, we will execute the 
0-function for output ji. As a result, all the nodes with inputs in S{yi) will be visited and 
marked by the algorithm during iteration ^+1. Thus we know that S(yi) c {U'g^,xi, . . . ,Xji}, 
that is, they form part of the set of marked inputs by the algorithm. 

Since the "partial" column T(5(ji), ji) is LI from the columns in the matrix T(S(>'i), {Uy- 
y\,UBy - U'g^}), it follows immediately that the column T{[U'g^,xi, . . .Xj^},y\) is LI from 
the columns in the matrix T{{U'g^, x\, . . . Xj^},{'J^^^^ -y\,UBy - U'g^]). Thus if we drop the 
column yy from the matrix T{[U'g^,X\, . . .Xj^},[Uy,UBy - U'^^]) the resulting matrix Ai = 
T{{U'„^, xu... Xj, }, - yu UBy - U'„^]) has rank \U'J - 1. 
Step k: Removing output y^. 

We start from the matrix A^.j = T({C/^^, xu ■ ■ ■ Xj^_^}, C^J/'^ - - ... - yk-\,UBy - U'j^y}) that 
has rank \U'g^\ - (k - 1). From lemma [3] the rows T{xj, {Uy - yi - ... - yt-i, UBy - U'^^}), 
jk-i < j < jk belong in the span of the matrix T([/g^, {Uy-yi- yk-u Usy - f/gy}). Thus 
adding these rows to matrix A^-^i does not increase its rank. 

On the other hand, from lemma [6] there exists a set of LI rows Sijk) Q {'R!'J''\ xi, . . . xy^_, } 
such that removing the column yk from the matrix T{S(yk), {'Ry''\ Usy - U'^^}) drops the rank 
of this matrix from to - 1. In other words, the column T(S (yk),yk) is LI from 

all the columns of the matrix T(S(yk), {'Ry'^ -yk, UBy-U'^J). But K^'^ contains all the outputs 
in Uy - yi - . . . - yk-i, and thus the column T(S(yk),yk) does not belong in the span of the 
columns T(5(y^), {Uy-yi- yk-i, UBy - U'^^}). 

Similar to before because the 0-function will be executed at yk, all the inputs in S{yk) 
are marked and S(yk) c {U'g^,xi, . . . ,XjJ. It again follows immediately that the column 
T({U'g^, Xi,. . . Xji^},yk) is LI from the columns in the matrix T({U'g^, Xi,. . . JCyJ, {"^j/'^ -yi - 
. . .-yk, UBy-U'g^}). Thus if we drop the column yk from the matrix T({U'g^,Xi, . . -Xj^}, {Uy-yi- 
■ ■ --yk-i, UBy-U'j^y]) the resulting matrix A^ = T({f/^^, xi, . . . xj,}, {1^y''^-yi-. . -yk, UBy-U'j^^}) 
has rank \U'g^\-k. 
Final step. 

At the end of this procedure, the matrix A^ = T({t/^^, x\,... Xj,}, {f^f^-yi-. . .-yt, UBy-Ug^}) 
has rank lU'^J - L and the required column set UBy Now to create the matrix T{Ubx, Ub^) 
we may need to add to A^ some additional rows. From Lemma |4] adding these rows cannot 
increase the rank of the matrix as they belong in the span of T{U'^^, UBy). This completes 
our proof. ■ 
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Lemma 6: Let j denote the number of already marked inputs when output y gets marked, 
and let denote the preceived set of used outputs from previous iterations at that time. 
Then there exists a set of rows S{y) in the set {'F^^\x\, . . . ,Xj] such that 

rankT(50;), {Kf, Ub, - f/^,}) = \S{y)\, while 

(16) 

rankT(S(3^), {^^ _ jj^^, _ f/^^ j) = |50;)| - 1. 

That is, removing the column y drops the rank of the matrix by one, and makes the rows 
S(y) LD. 

Proof: Consider iteration ^ + 1 and layer i. Assume that the node where an output y in 
Uy belongs gets visited for the first time. This can happen in two ways: 

« Case 1: The node A(y) gets visited while we perform an Ljc- function at layer i + 1 (see 
examples [3] and |4l). Note that sice we have arrived at layer / + 1, we have identified at 
layer i an edge ix',y') that is LI from the K edges identified from previous iterations. 

• Case 2: The node A(y) gets visited when we find an edge ix',y') in layer i with 
rankT({<:'\ x'}, {'R-l!''),/} = K+1 (see examples [21 and [3]). 
The arguments in these two cases are very similar, and we treat them together. In both cases, 
at layer /, we start with the (K+\)x{K + 1) full rank matrix T({'R[^\ x'}, {'R\^\y'}). When we 
remove the column y clearly the resulting {K + I) x K matrix has some linearly dependent 
rows. As a result, a subset of the rows becomes linearly dependent. Define S(y) to be the set 
of inputs in ['Rf'J\x'} corresponding to the minimally linearly dependent rows in the matrix 
T{{'Rf'J\ x'}, {'Ry '' -y,y'}), where by minimally linear dependent we mean that the vectors in 
the set are linear dependent but any proper subset of them is a linearly independent set of 
vectors. Note that the inputs in S(y) are exactly the inputs that are going to be visited when 
the algorithm performs the ^-function for output y, as, removing any of the rows in S(y) 
from the matrix T({'R''J\x'}, {'Ry '' -y,y'}) results in a full rank K x K submatrix. 

Now, since T{{'Rx\x'},{'Ry\y'}) is a full rank matrix then there is no set of rows of this 
matrix which are linearly dependent. In particular, the rows in S (y) are linearly independent. 
The matrix TiS (y), {'Ry\y' , Ub), - Ub/}) contains the full rank submatrix TiS(y),{'R^y\y'}) 
and thus has also rank \S(y)\. That is 

rankT({^(/, x'}, {'R^Ky'}) = rankT({^V\ ^'l i^\y', UBy - Ubv}) = if + 1, and 

(17) 

rankT(5(y), {'R'^'Ky'}) = mnkT{S(y), {'Rf,y', UBy - Ubv)) = \S(y)\. 
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Moreover, from construction, 

rankT({^^-'\ x'}, {'R^'^ - y,y'}) = K, and 

(18) 

rankT(5(y), {K^J^ - y,y'}) = \S(y)\ - 1. 
We will next argue that 

rankT({^(^\ x'}, {lif - y,y', U^y - f/ey}) = K, and 

(19) 

rankT(5(3;),{^^> -y,/, Usy - Uby)) = \S(y)\ - 1. 

that is, adding the columns in UBy - Usy' does not increase the rank. 

Let Jo be a column in U By - U By' , and consider the matrix T{{'R''J\ x'}, {RyP -y, j', jo})- If this 
square matrix has rank ^+1, then the rows T(5' (y), {Ry'' -y,y',yo}) must be LI. Since the rows 
T(5'(3;), {'Ry"' - y,y'}) are LD, there exists row xq € S(y) with a nonzero value in the column 
yo. But when we run the ^-function, as we already mentioned, all inputs in S(y) including xq 
are visited and explored. Thus if the T({!/?^-'\ x'}, {'Ry^ -y,y',yo}) were full rank, the output yo 
would get marked and not appear in Usy - Uby- We conclude that for every y^ in UBy - Uby, 
the column ,x'},yQ}) belongs in the span of the columns T{{'}^^\x'),{1^y^^ -y,y']), and 

thus, the matrix T{{Rf ,x'},{'F!f - y,y' , UBy - Uby)) has rank K. 

Next note that, the rows in matrix T{S(y),{f^y^ - y,y'}) do not belong in the span of 
the LI rows Ti^f - S{y),{1^j^ - y,y'}). Let yo be a column in C/gy - Uby- Clearly, the 
rows T{S(y), {Hf - 3;,3;',3;o}) do not belong in the span of the LI rows Tili^^ - S(y), {Hf - 
y,y',yo\). Thus, if the rows T{S{y), \1^-y,y',yS were LI, the matrix T(<^\ {Kf -y,y' ,y(^]) 
would have rank ^+1, which is not possible from our previous argument. We conclude that 
rankT(S(3;), -y,y', UBy - Uby)) = \S(y)\-l. We have thus proved that 

rankT(5();), m^^Ky', UBy - Uby)) = \S(y)\, while 

(20) 

rankT(5(3;),{^^'^ -y,y', UBy - Uby)) = \S(y)\ - 1. 
Removing the column y' from the last equation, we also get that 

rankT(5(3;), {'R^^ -y, UBy - Uby)) < I^Cv)! - 1. (21) 

We now distiguish two cases: 
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1) S{y) Q 'R''J\ i.e., the set of rows S{y) does not contain x'. Then 

rankT(5(3;), {K^JK Usy - t/sy}) = \S{y)\ - 1, (22) 

since these rows are LI, and (|20l) - ((22)) imply (fT6l) . 

2) x' e S'iy), we have two subscases: 

a) if rankT(5(j), Ubj - f/sv'}) = l-^Cv)!, this together with (EB implies 

b) if rankT(5(y), t/sv-t^B/}) = l-^WI-l, then given ^ the column / does not 
belong in the span of the columns UBy-UBy]- Similarly, again from (|20l) . the 
column y does not belong in the span of the columns {^J^ -y,y\ Usy - Usy}- We 
conclude that rankT(5 (y), [I^J^ -y, Uey - t/sy }) = \S {y)\ - 2, and thus rankT(5 (j) - 
x', {l^j^ - y, UBy - Ubv)) < \S(y)\ - 2. But rankT(50;) - x\ Usy - Usy}) = 
\S(y)\ - 1. For the set S'(y) = S(y)- x' , the claim in ([H) follows. 



E. Algorithm Complexity 

Proposition 4: The complexity of the algorithm in Table H] is 0{C^{0,otai + ^ihotai)), where 
C is the capacity of the network, lumi equal the total number of inputs and 0,otai is the total 
number of outputs in the network. 

Proof: At iteration K, the complexity of the function "FindL(T)" is 0{K^), "Match(T)" 
is 0{K^), to find which inputs to visit with the ^-function is 0{K^), and the rank calculations 
are 0{K^). When we visit each input we will perform at most A/ rank calculations, where 
A/ is the maximum outdegree of an input. This results in complexity 0{lS.iK^). Moreover, 
we will perform the "FindL" function at most once for every input. Performing the "FindL" 
function at the K iteration might result in at most K inputs to be revisited. For each of 
the revisited inputs, the associated complexity will be 0{lS.jK^). Thus, the total complexity 
when visiting each input is 0{lS.iK^). These operations will be repeated at most lunai times. 
An upper bound for I total is l^l, where E is the set of all edges in the network, but this 
bound might be very loose, if the inputs have small outdegree. To conclude, examining the 
inputs results in complexity of O(AjK'^Itotai)- When each output is marked, we will perform 
exactly once the 0-function. Thus, this function will be performed at most once for every 
output (if the output gets marked during the iteration), and contributes complexity 0{K^Ou,tai)^ 
where (again, a loose upper bound for Ototai is l^l). After C iterations the total complexity 



33 



is 0{C\Ototal + ^ihotal)). 



IV. Conclusions 

In this paper we develop a polynomial time algorithm for unicast connections that allow 
to achieve the min-cut capacity in networks of linear deterministic channels over a finite 
field F^^. Such networks have recently found applicability as approximate models for wireless 
Gaussian networks, by modeling broadcasting and interference through linear operations over 
a finite field. Our scheme allows to identify the min-cut value in polynomial time, and to 
achieve this value using very simple one symbol mapping operations at the intermediate 
network nodes. 
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Algorithm III.l: set of functions and E^{.) 

{(J,V)] = Ea{G,'P,M,A) 
if M{A) == T return (F) 
else 

M(A) = T 

U <- {used edges in L(A)-layer cut}, 1/^ <- {Xi £ U}, Uy <- [jj eU], X <r- {xi e A 
Vjc, 6 X, if Xi i Uy, and M{xi) == F and £;,(G, P, M, Xi) == T return (T) 
return (F) 



if yj £ Uy ■ 



{(T,F)} = E,(G,r,M,xd 
if M(xi) == T return (F) 
else 

M(Xi) = T 

if ML{Xi) == (we perform this function only once per input) 
(MLixi) = T 

L, = FindL(T({C/„x,},C/y)) 
V Xk £ 

fMatch(T({L,-x,,x,},Ly)) 
Update(!P) 
if M(Aix,)) == F 

V y^: € A{Xk) perform 0-function(3'i) (see description following) 

if Ea{G, P, M, A(xt)) == T return (T) 
else UM(x,)-=Ti^'' Mix,)=F 
Restore(P) 

fif rank(T({t/,, x,}, {[/,, j,})) = 1 + rank(T([/„ f/,)) 
rif A{yj) == Destination return (T) 
if M{A{yj)) == F 

yyt £ Uy with A(yk) == A(yj) and (jCi,};^) e f/ 
(\/Xk £ U, 

if T({C/;, - Xk, xi}, [Uy - yk,yj})) is full rank 
Uy = {Uy- yk,yj}, t/.v = {U^- Xk, Xi) 
Update(5P) 
if M{A{xk)) == F 

V G A(x^) perform 0-function(3'^) 

if Ea(G, r, M, A{xk)) == T return (T) 
else 

if M(xk) == T 
Set M(xk) = F 

if E,(G, r, M, Xk) == T return (T) 
[Restore(f) 
if Ea(G, P, M, Afyj)) = T return (T) 
return (F) 



if yj t Uy ■ 



- function(3;/;) 
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TABLE I 

The functions Ea{-) and £'^( ) are executed by the algorithm at each explored node or edge. The function 
"Match(T)" finds a perfect matching in the bipartite graph defined by matrix T as described in proposition[T1 
The function "Fd4dL(T)" finds the smallest set of rows that are LD with the last row of T as described in 
PROPOSITION 121 The function "Update('P)" keeps track of the current wiring of identified paths (which may 

CHANGE EITHER BY THE EXECUTION OF THE MATCH FUNCTION, OR BY THE (^-FUCNTION), WHILE "ReST0RE(!P)" RESTORES f TO 



F 


finite field of operation 


S 


tlie source node 


D 


the destination node 


A 


number of network layers 


M 


maximum number of nodes per layer 


A{x) 


node where input x belongs 


My) 


node where output y belongs 


T(V, W) 


transformation matrix whose rows are labeled with the elements of V 
and the columns with the elements of W 


\u\ 


number of identified LI paths in previous iterations 


u 


set of used channels between layers i and i + 1 (we drop the index i for simplicity) 


T J 

Ux 


set of used inputs at layer i corresponding to the channels in u 


T T 
Uy 


set of used outputs at layer i + 1 corresponding to the channels m U 


tod) 


the set of edges that input x, perceives as being used from previous iterations 


K 


iJ?* J. aA J. ' A. ' 1* 1J? ■ ' J. J.' 

set of inputs that input x, perceives as being used from previous iterations 




set of outputs that input x, perceives as being used from previous iterations 




the smallest subset of K-'' in the matrix TCk >,Z) 
that contains x, in its span 




set of visited nodes in the / layer 


w; 


set of unvisited nodes in the i-th layer 




set of all the inputs of the nodes in 




set of all the visited inputs in the layer i which are used, i.e. Ubx' = Ubx^ Ux- 




set of all the outputs in W-^^ 




set of all the outputs of Ugy which are used, i.e., Ugy' = Ugy V^. 


^total 


total number of inputs in the network. 


Ototal 


total number of outputs in the network. 



TABLE II 
Summary of Notation 
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